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We investigate the limit behavior of the Z/fe-distance between a 
decreasing density / and its nonparametric maximum likelihood es- 
timator /„ for fc > 1. Due to the inconsistency of /„ at zero, the case 
k = 2.5 turns out to be a kind of transition point. We extend asymp- 
totic normality of the Li-distance to the Lfe-distance for 1 < fc < 2.5, 
and obtain the analogous limiting result for a modification of the Lk- 
distance for k > 2.5. Since the Li-distance is the area between / and 
fn, which is also the area between the inverse <? of / and the more 
tractable inverse (7„ of /„, the problem can be reduced immediately 
to deriving asymptotic normality of the Li-distance between Un and 
g. Although we lose this easy correspondence for > 1, we show that 
the Lfe-distance between / and /„ is asymptotically equivalent to the 
Lfc-distance between f/„ and g. 

1. Introduction. Let / be a nonincreasing density with compact sup- 
port. Witiiout loss of generality, assume this to be the interval [0,1]. The 
nonparametric maximum likelihood estimator /„ of / was discovered by 
Grenander [2]. It is defined as the left derivative of the least concave ma- 
jorant (LCM) of the empirical distribution function Fn constructed from a 
sample Xi, . . . ,Xn from /. Prakasa Rao [11] obtained the earliest result on 
the asymptotic pointwise behavior of the Grenander estimator. One imme- 
diately striking feature of this result is that the rate of convergence is of the 
same order as the rate of convergence of histogram estimators, and that the 
asymptotic distribution is not normal. It took much longer to develop distri- 
butional theory for global measures of performance for this estimator. The 
first distributional result for a global measure of deviation was the conver- 
gence to a normal distribution of the Li-error mentioned in [3] (see [4] for a 
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rigorous proof). A similar result in the regression setting has been obtained 
by Durot [1]. 

In this paper we extend the result for the Li-error to the L/;-error, for 
A; > 1. We will follow the same approach as in [4] , which, instead of comparing 

to /, compared both inverses. The corresponding Li-errors are the same, 
since they represent the area between the graphs of /„ and / and the area 
between the graphs of the inverses. Clearly, for /c > 1 we no longer have such 
an easy correspondence between the two L^-errors. Nevertheless, we will 
show that the L^-error between /„ and / can still be approximated by a 
scaled version of the L^-error between the two inverses and that this scaled 
version is asymptotically normal. 

The main reason to do a preliminary inversion step is that we use results 
from [4] on the inverse process. But apart from this, we believe that work- 
ing with /„ directly will not make life easier. For a G [/(l),/(0)], the (left 
continuous) inverse of /„, is Un{a) = sup{x € [0, 1] : fn{x) > a}. Since fn{x) is 
the left continuous slope of the LCM of F„ at the point x, a simple picture 
shows that it has the more useful representation 

(1.1) Un{a) = argmax{F„(2;) — ax}. 

xe[o,i] 

Here the arg max function is the supremum of the times at which the max- 
imum is attained. Since Un{o) can be seen as the x-coordinate of the point 
that is touched first when dropping a line with slope a on F„, with proba- 
bility one fnix) < a if and only if Un{a) < x. Asymptotic normality of the 
Lfc-error relies on embedding the process Fn{x) — ax into a Brownian motion 
with drift. The fact that the difference between Fn{x) — ax and the limit 
process is small directly implies that the difference of the locations of their 
maxima is small. However, it does not necessarily imply that the difference 
of the slopes of the LCMs of both processes is small. Similarly, convergence 
in distribution of suitably scaled finite-dimensional projections of C/„ follows 
immediately from distributional convergence of Fn, after suitable scaling, 
and an arg max type of continuous mapping theorem (see, e.g., [6]). When 
working with /„ directly, similar to Lemma 4.1 in [11], one needs to bound 
the probability that the LCM of a Gaussian approximation of Fn on [0, 1] 
differs from the one restricted to a shrinking interval, which is somewhat 
technical and tedious. 

Another important difference between the case A; > 1 and the case k = 1 
is the fact that, for large k, the inconsistency of fn at zero, as shown by 
Woodroofe and Sun [13], starts to dominate the behavior of the L^-error. 
By using results from [9] on the behavior of /„ near the boundaries of the 
support of /, we will show that, for 1 < A; < 2.5, the Ly^-error between fn 
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and / is asymptotically normal. This result can be formulated as follows. 
Define, for c G M, 

(1.2) y(c) =argmax{W(t) - (t-c)^}, 

(1.3) e(c) = V{c) - c, 

where {VF(t) : —oo <t< oo} denotes standard two-sided Brownian motion 
on M originating from zero [i.e., 14^(0) = 0]. 

Theorem 1.1 (Main theorem). Let f be a decreasing density on [0,1] 
satisfying: 

(Al) < /(I) < f{y) < fix) < /(O) < cx), /or < X < y < 1; 
(A2) / is twice continuously differentiahle; 
(A3) inf,e(o,i)l/'(^)l>0. 

Then for l<k< 2.5, with /i^ = {E\V{{))\^fQ{4.f{x)\f'{x)\f/^dxY/'', the 
random variable 

converges in distribution to a normal random variable with zero mean and 
variance 

icLll^I^ LM^L . 8 / cov(|C(0)|^ |e(c)|'=) dc. 

A;2(^|y(0)|'=/o^(/(rc)|/'(2;)|)fc/3(ix)(2fc-2)/fc ^ viswi,i^v;i; 

Note that the theorem holds under the same conditions as in [4]. For 
k > 2.5, Theorem 1.1 is no longer true. However, the results from [9] enable 
us to show that an analogous limiting result still holds for a modification of 
the Lfc-error. 

In Section 2 we introduce a Brownian approximation of [/„ and derive 
asymptotic normality of a scaled version of the L^-distance between Un and 
the inverse 5 of /. In Section 3 we show that on segments \s,t\ where the 
graph of /„ does not cross the graph of /, the difference 

\f I . , /-/W |C4(a)-5(a)^ , 

\fn{x)-f{x)\ dx- — I — da 

Jf{t) \9{a)r ^ 

is of negligible order. Together with the behavior near the boundaries of 
the support of /, for 1 < A; < 2.5 we establish asymptotic normality of the 
Lfc-distance between and / in Section 4. In Section 5 we investigate the 
case A; > 2.5 and prove a result analogous to Theorem 1.1 for a modified 
Lfc-error. 
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Remark 1.1. With almost no additional effort, one can establish asymp- 
totic normality of a weighted Lfc-error n'^^^ Jq \ fn{t) — f{t)\^w{t)dt, where 
w is continuously differentiable on [0, 1]. This may be of interest when one 
wants to use weights proportional to negative powers of the limiting stan- 
dard deviation {■^fit)\f'{t)\)^/^ of /„,(t). Moreover, when w is estimated at 
a sufficiently fast rate, one may also replace w by its estimate in the above 
integral. Similar results are in [8] for a weighted L^-error. 

2. Brownian approximation. In this section we will derive asymptotic 
normality of the L^-error of the inverse process of the Grenander estimator. 
For this we follow the same line of reasoning as in Sections 3 and 4 in [4]. 
Therefore, we only mention the main steps and transfer all proofs to the 
Appendix. 

Let En denote the empirical process y/n{Fn — F). For n > 1, let Bn be 
versions of the Brownian bridge constructed on the same probability space 
as the uniform empirical process En o F"^ via the Hungarian embedding, 
and define versions Wn of Brownian motion by 

(2.1) Wnit)=Bnit)+Ut, te[0,l], 

where is a standard normal random variable, independent of Bn- For fixed 
a G (/(I), /(O)) and J = E,B, W, define 

y/(a) = argmax{X;f (a, t) + n^^^[F{g{a) + n~^^^t) 



(2.2) 
where 



F{g{a))-n-'/'at]}, 



X^ia,t) = n^'^EMa) + n-^'h) - En{g{a))}, 

(2.3) (a,t) = ni/6{i?„(i7(5(a) + n-^'h)) - Bn{F{g{a)))} , 

X^{a,t) = n'^^{Wn{F{gia) + n-'/H)) - Wn{F{g{a)))} . 

One can easily check that Vn{a) = n^^^{Un{a) — g{a)}. A graphical inter- 
pretation and basic properties of are provided in [4]. For n tending to 
infinity, properly scaled versions of will behave as ^(c) defined in (1.3). 

As a first step, we prove asymptotic normality for a Brownian version 
of the Lfc-distance between Un and g. This is an extension of Theorem 4.1 
in [4]. 

Theorem 2.1. Let he defined as in (2.2) and ^ by (1.3). Then for 
k>l, 

„i/6 ff^'^ \V^iat-E\Vn^iat . 
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converges in distribution to a normal random variable with zero mean and 
variance 

a^ = 2 (4/(x))(2'=+i)/3|/'(x)|M/3dx / coY{\m\\Uct)dc. 
Jo JO 

The next lemma shows that the hmiting expectation in Theorem 2.1 is 
equal to 

(2.4) f^k = [E\V{0tJ^ {4f{x)\f'{x)\f'dxj . 



Lemma 2.1. Let be defined by (2.2) and let be defined by (2.4). 
Then for k>l, 

lim n^'H / ' ",,7^ da - /iM = 0. 

U/(i) \9'{a)\^-^ '^M 

The next step is to transfer the result of Theorem 2.1 to the L^-error of 
V^. This can be done by means of the following lemma. 

Lemma 2.2. For J = E,B,W, let V^be defined as in (2.2). Then for 
k>l, we have 

n'" {\V^{at-\V^{at)da = o,{l) 

and 

fj(0) 

/ llVf («)!' - \Vrf{at\ da = 0,{n-^'\\ognf+\ 

From Theorem 2.1 and Lemmas 2.1 and 2.2, we immediately have the 
following corollary. 

Corollary 2.1. Let Un be defined by (1.1) and let Hk be defined by (2.4). 
Then for k>l, 

V ^(1) l9'(o)l' ' '/ 

converges in distribution to a normal random variable with zero mean and 
variance cr^ defined in Theorem 2.1. 
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3. Relating both Lfc-errors. When k = l, the L^-error has an easy inter- 
pretation as the area between two graphs. In that case / \ Un{a) — g{a) \ da is 
the same as / \ fn{x) — f{x)\ dx, up to some boundary effects. This is precisely 
Corollary 2.1 in [4]. In this section we show that a similar approximation 
holds for X? \fn{x) -f{x)\^dx on segments [s,t] where the graphs of /„ and 
/ do not intersect. In order to avoid boundary problems, we will apply this 
approximation in subsequent sections to a suitable cut-off version /„ of . 



Lemma 3.1. Let /„ he a piecewise constant left- continuous nonincreas- 
ing function on [0,1] with a finite number of jumps. Suppose that /(I) < 
fn < /(O), and define its inverse function by 

Un{a) = sup{x £ [0, 1] : fn{x) > a}, 

for a G [/(I), /(O)]. Suppose that [s,t] C [0, 1], such that one of the following 
situations applies: 

1- fnix) > f{x), for X £ {s,t), such that fn{s) = f (s) and fnit+) < f (t) . 
2. fn{x) < f{x), for X e {s,t), such that fn{t) = fit) and fn{s) > f{s). 



If 

(3.1) 

then for k>l, 



sup \fn{x) - f{x)\ < (^"^^e^O'il 

xG[s,t] 2sup^g[o,i] 



\fn{x)-f{x)\ dx- 1 

Jf{t) b (a)r 



da 



S{s) = ao - 
«i - 



m 



^ function /„ 




Fig. 1. Segment [s,t\ where /„ > /. 
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< c 



f^')\Un{a)-g{a)\^ 



k+l 



Ifit) la'iaW 
where C > depends only on f and k. 



■ da, 



Proof. Let us first consider case 1. Let have m points of jump on 
(s, t). Denote them in increasing order by < • • • < and write s = ai^d 
Cm+i = t- Denote by ai > • • • > Om the points of jump of C/„ on the interval 
(/(t),/(s)) in decreasing order, and write f{s) = oq and am.+i = f{t) (see 
Figure 1). We then have 

f \fn{x) - f{xt dx = f2 f^^' \~Ui^+l) - /(^)l' dx. 



i=0 



Apply a Taylor expansion to / in the point g{ai) for each term, and note 
that fni(,i+i) = cti. Then, if we abbreviate gi = g{oii) for i = 0, 1, . . . , m, we 
can write the right-hand side as 



Y: / ' \f' {9^)\\x - g,f 



i=0 



dx 



for some 6i between x and gi, also using the fact that gi < d < x < ^i+i. 
Due to condition (3.1) and the fact that fn{(,i+i) = fn{x), for x G (^i,^j+i], 
we have that 



(3.2) 



fidi 



f'i 



■{x-gi) 



< 



< 



sup|ri|/(x)-/(g,)| 
inf|/'| inf|/'| 

supin , „, , . , 1 



(inf|/ 



^\f{x)-Uix)\< 



<ki- 



k-1 



supir 



2inf|/ 



Hence, for x £ (Cj,6+i] 

r(g.)(x-g.) ^ 
2f'{g^) 

Therefore, we obtain the inequality 

/ \f^[x)-f{xtdx-Y, \f'{gi)\\x-gifdx 

-Is i=QHi 

<CiY.I {x-g,)''+Ux, 
where Ci = /csup |/'|'^(5/4)'^~^(sup |/"|)/(2inf |/'|), or after integration, 

\fnix)-fixtdx 
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(3.3) 



-. m 



Next consider the corresponding integral for the inverse C/„. Since gi <x < 
Qij^i < ^i+i, we can write 



/(-) |^„(a)-ff(a)|^ ^^_ - 



m \g'{a)\' 



■ da 



Apply a Taylor expansion to /' at the point gi. Using (3.2), by means of the 
same arguments as above, we get 



da 



/W |^n(a)-g(a)|^ 
/{*) b'(a)|^-i 

1 m 

-y E \f'i9^t{i^^+l - 9^f^' " (^.+1 " 9^+l?^'] 



k + 



(3.4) 



1=0 

gi+i 



<Ci / (^i+i -x)''(2;-5fi)dx 



gi+i 



<Ci{^i+i-gi) / (Cm - a;)'' da: 

For the third integral in the statement of the lemma, similarly as before, 
again using (3.2), we can write 



M \Unia) - g{a)\ 



fc+i 



■ da 



fit) 



(3.5) 



\9'ia)\' 

E / ' \n9^t^\^^+l 
- =0 ■'9^ 



\k+l 



f"(9) 
f {9i) 



m 



k + 2 

whereC2 = (inf|/'|/2) 



i=0 
/I /n\fe + l 
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Now let us define A as the difference between tlie first two integrals, 



A 



dcf 



\fn{x)-f{xtdx 



n^) \Un{a) - g{a)\^ 



da. 



hit) ^ 

By (3.3) and (3.4) and the fact that = 90 and ^m+i = dm+i, we find that 



|A| < dY^{^,+, - 5m)'+'ll/'(5.)l' - l/'(5m; 



(3.6) 



i=0 



i=0 



where D is a positive constant that depends only on the function / and k. 
By a Taylor expansion, the first term on the right-hand side of (3.6) can be 
bounded by 

r(^.)(9m-9^)|' 



I)^(^,+i-g,+i)^+V(5.-^" 



i=0 



1 



1 + 



/'( 



< C-iJ2i^i+i - 9i+i)''^H9i+i - 9i) 



i=0 
m 



< Cs Eite+i - 5.)'+' - (^.+1 - 5.+i)'+'}, 

1=0 

with C3 depending only on / and k, where we also use (3.2), the fact that 
Qi < Qi+i < ^i+i, and that according to (3.1), we have that (ffi+i — 9i) x 
sup |/"|/ inf l/'l < ^. Putting things together and using (3.5), we find that 

m 

|A| < CY^m+i - 9if^^ - (^.+1 - 5^+1)'+'} 

j=0 



<C5 



/W \Un{a)-g{a)\ 



k+l 



m 



b'(a)l' 



■ da, 



where C5 depends only on / and k. This proves the lemma for case 1. For 
case 2 the proof is similar. □ 

4. Asymptotic normality of the Lfc-error of We will apply Lemma 3.1 
to the following cut-off version of /„,: 



(4.1) 



/(O), if/n(x)>/(0), 
fn{t) = {Ux), if/(l)</„(x)</(0), 

/(I), if/„(x)</(l). 



The next lemma shows that fn satisfies condition (3.1) with probability 
tending to one. 
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Lemma 4.1. Define the event 

An=\ sup \fn{x)- f{x)\<- -^-^TJiT^ \ ■ 

Ug[0,1] 2suPig[o,i]|/"(x)| J 

Then P{A^} ^ 0. 

Proof. It is sufficient to show that sup \fn{x) — f{x)\ tends to zero. For 
this we can follow the hne of reasoning in Section 5.4 of [5]. Similar to their 
Lemma 5.9, we derive from our Lemma A.l that, for each a £ (/(I), /(O)), 

P{\Un{a)-g{a)\>n~^/''logn}<Ciexp{-C2{lognf}. 

By monotonicity of C/„ and the conditions of /, this means that there exists 
a constant C3 > such that 

p\ sup \Un{a)-g{a)\>C3n-^/Hogn\<Ciexp{-^C2{lognf}. 

This implies that the maximum distance between successive points of jump 
of /„ is of the order 0{n~^^^logn). Since both /„ and / are monotone and 
bounded by /(O), this also means that the maximum distance between 
and / is of the order 0{n~^^^logn). □ 

The difference between the L^-errors for /„ and /„ is bounded as 



(4.2) 



' l/n(x) - fixtdx - [' \fn{x) - f{xtdx 

Jo 

</ \fn{x)-fixtdx+ \fn{x)-fixtdx. 

Jo Ju„ifW) 



The next lemma shows that the integrals on the right-hand side are of neg- 
ligible order. 

Lemma 4.2. Let Un be defined in {I. I). Then J^"'-^'-^^^ \fn{x) - f{x)\^ dx -- 
Op(n-(2'=+i)/6), and J^^^^^,^^ - dx = Op(n-(2'=+i)/6). 



Proof. Consider the first integral, which can be bounded by 
(4.3) 



2" / \fn{x)-f{0tdx + 2'' / \f{x)-f{Otdx 

Jo Jo 



<2'= / |/„(x)-/(0)|'=dx + -— supl/f [/„(/(0))'=+i. 

Jo k + 1 
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Define the event B„ = {f/„(/(0)) < n-^/'^^logn}. Then [/„(/(0))''+^lij„ = 
Op{n~^'^^^^^^^). Moreover, according to Theorem 2.1 in [4], it fohows that 
P{B^} — > 0. Since for any r] > 0, 

P(n(2'=+i)/6|C/„(/(0))|'=+HBc > r?) < P{i?^} ^ 0, 
this implies that the second term in (4.3) is of the order 

Op(n-(2fc+i)/6). The 

first term in (4.3) can be written as 

2M / \Ux)-f{Otdx)lB„ 



(4.4) 

rUMiO)) 



+ 2^' 



l/n(x)-/(0)|'^dxjlBS 



where the second integral is of the order Op{n~^'^^~^^'>/^) by the same reasoning 
as before. To bound the first integral in (4.4), we will construct a suitable 
sequence (oj)^]^, such that the intervals (0,n~"^] and (n~°',n~°'+i], for 
« = 1, 2, . . . , m — 1, cover the interval (0, C/„(/(0))] , and such that the integrals 
over these intervals can be bounded appropriately. First of all let 

(4.5) 1 > ai > 02 > • • • > ttm^i > 1/3 > Om, 

and let = and Zi = n~"'^ , i = 1, . . . ,m, so that < zi < • • • < Zm~i < 
n"^/'^ < Zjji- On the event B^, for n sufficiently large, the intervals (0, n~"i] 
and {n~"'\n~"-^+^] cover (0, C/„(/(0))]. Hence, when we denote Ji = [zi A 
f^n(/(0)), Zj+i A C^n(/(0))], the first integral in (4.4) can be bounded by 

m— 1 y „ s m— 1 

E / CUx)-f{G)fdx)lB„ < 5:(z,+i-z,)|A(z,)-/(0)^ 

using that /„ is decreasing and the fact that Jj C (0, C/„(/(0))], so that 
fn{zi) — /(O) > fn{x) — /(O) > 0, for X G Ji. It remains to show that 

m—l 

(4.6) E (z,+i - z,)\Uz,) - = Op(n-(2'^+i)/6). 

From [13] we have that 

(4.7) /„(o)^/(0) sup 

l<j<oo i j 

in distribution, where Tj are partial sums of standard exponential random 
variables. Therefore, 

(4.8) zi|/40)-/(0)|*= = Op(n-'^^). 



12 V. N. KULIKOV AND H. P. LOPUHAA 

According to Theorem 3.1 in [9], for 1/3 < a < 1 

(4.9) ^(i-")/2(/^(^-")_/(^-"))^^ 

in distribution, where Z is a nondegenerate random variable. Since for any 
i = 1, . . . , m — 1 we have that 1/3 < < 1, it follows that 

\fn{Zi) - /(0)| < \fn{z,) - f{Zi)\ + Snp\f'\Zi 

This implies that, for i = 1, . . . , m — 1, 

(4.10) (z,+i - z,)\fn{z.) - f{Ot = Op(n-»'+i-'=(i-"')/2). 
Therefore, if we can construct a sequence (oj) satisfying (4.5), as well as 

(4.11) ai>——, 

o 

k(l-ai) 2k + I 

(4.12) a,+i + ^ ^ > for alH = l,...,m-l, 

then (4.6) follows from (4.8) and (4.10). One may take 
2k + 7 



ai 



12 



k{ai-l) 2k + 3 

= n \ z — for z = 1, . . . ,m - 1. 

z o 

Since k < 2.5, it immediately follows that (4.11) and (4.12) are satisfied. 
To show that (4.5) holds, first note that 1 > ai > 1/3, because k < 2.5. It 
remains to show that the described sequence strictly decreases and reaches 
1/3 in finitely many steps. As long as > 1/3, it follows that 

2-k 2k -3 

ai - ai+i = ai H — . 

z o 

When k = 2, this equals 1/8. For 1 < k < 2, use a,, > 1/3, to find that 
Oj — Oj+i > 1/24, and for 2 < A; < 2.5, use < oi = {2k + l)/7, to find that 
ai — Oj+i > (A; + 1)(2.5 — A;)/12. This means that the sequence (a^) also sat- 
isfies (4.5), which proves (4.6). This completes the proof of the first integral 
in the statement of the lemma. The proof for the second integral is similar. 
□ 

We are now able to prove our main result concerning the asymptotic 
normality of the L^-error, for 1 <k < 2.5. 

Proof of Theorem 1.1. First consider the difference 

(4.13) /'i/„w-/wi^^x-r' i^';'?':ff^ - 

Jo Jf(i) \g'{a)r 
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(4.14) 
where 







\f.,{x)-f{xtdx- / \fn{x)-f{xtdx 







+ Rn 



Rn 



\fn{x)-f{xtdx 



m \Un{a)-g{at 



/(I) 



\9'{t)\ 



k-l 



da 



Let An be the event defined in Lemma 4.1, so that P{A'^} ^ 0. As in the 
proof of Lemma 4.2, this means that i?„]l^c = Op{n~^'^^~^^^^^). Note that on 
the event An, the function satisfies the conditions of Lemma 3.1, and 
thatfor anyaE[/(l),/(0)], 

Un{a) = sup{t G [0, 1] : > a} = sup{t G [0, 1] : > a} = C7„(a). 

Moreover, we can construct a partition [0, si], (si, S2], • • • , (sz, 1] of [0,1] in 
such a way that, on each element of the partition, /„ satisfies either condition 
1 or condition 2 of Lemma 3.1. This means that we can apply Lemma 3.1 to 
each element of the partition. Putting things together, it follows that Rn'^^An 
is bounded from above by 



C 



m \Un{a) - g{a)\ 



fc+i 



■ da. 



Corollary 2.1 implies that this integral is of the order Op{n~^^^^^^^), so that 
-RnlA„ = Op(n~(^'^+^)/^). Finally, the first difference in (4.14) can be bounded 
as in (4.2), which means that, according to Lemma 4.2, it is of the order 
Op(?i~(^'^"'~^)/^). Together with Corollary 2.1, this implies that 

n^/' (n'^' £ l/n(x) - f{xt dx - /z^) ^ iV(0, a^), 

where fx^ is defined in Theorem 2.1. An application of the (5-method then 
yields that 



n 



\fnix)-f{x)\'dx 



1/k 



converges to a normal random variable with mean zero and variance 
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5. Asymptotic normality of a modified Lfc-error for large k. For large 
fe, the inconsistency of at zero starts to dominate the behavior of the L^- 
error. The following lemma indicates that, for k > 2.5, the result of Theorem 
1.1 does not hold. For A: > 3, the L^-error tends to infinity, whereas for 
2.5 < A; < 3, we are only able to prove that the variance of the integral 
near zero tends to infinity. In the latter case, it is in principle possible that 
the behavior of the process — / on [0, Zn] depends on the behavior of 
the process on [z^, 1] in such a way that the variance of the whole integral 
stabilizes, but this seems unlikely. The proof of this lemma is transferred to 
the Appendix. 

Lemma 5.1. Let Zn = l/(2n/(0)). Then we have the following: 

(i) Ifk>?>, thenn^'^Ejl\fn{x)-f{x)\^dx^oo. 

(ii) Ifk> 2.5, then var(7i(2fc+i)/6 y^^^) - f{x)\^ dx) oo. 

Although Lemma 5.1 indicates that, for k > 2.5, the result Theorem 1.1 
will not hold for the usual L^-error, a similar result can be derived for a 
modified version. For k > 2.5, we will consider a modified L^-error of the 
form 

(5.1) " r \fn{x)-f{xtdx^ -Mfc 

where /i^ is the constant defined in Theorem 1.1. In this way, for suitable 
choices of e we avoid a region where the Grenander estimator is inconsistent 
in such a way that we are still able to determine its global performance. 

We first determine for what values of e we cannot expect asymptotic 
normality of (5.1). First of all, for e > 1, similar to the proof of Lemma 5.1, 
it follows that 

var(^n(2'=+i)/6£_" |/„(x) - f{x)\^dx^ ^ oo. 

For e < 1/6, in view of Lemma 3.1 and the Brownian approximation dis- 
cussed in Section 2, we have that the expectation of 

/rl—n~'^ 



{ Jn-^ \fnix)-f{xrdx-fil 

will behave as the expectation of 

which, according to Lemmas 2.1 and A. 5, is of the order 0{n^^^^^). Hence, 
we also cannot expect asymptotic normality of (5.1) for e < 1/6. Finally, for 
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{k — I) /{3k — 6) < e < 1, a more tedious argument, in the same spirit as the 
proof of Lemma 5.1, yields that 

var(^n(2^+i)/'^y _^ - /{xtdxj ^ oo. 

Hence, in order to obtain a proper hmit distribution for (5.1) for k > 2.5, 
we win choose e between 1/6 and {k — l)/(3fc — 6). 

To prove a result analogous to Theorem 1.1, we define another cut-off 
version of the Grenander estimator, 

r /(n-^), if/„(x)>/(n--), 
/n(^) = \ fn{x), if /(I - n~') < U{x) < f{n-'), 

t/(l-n-^), if /„(x)</(l-n--), 

and its inverse function 

(5.2) U'^{a) = sup{x G [n-^ 1 - n"^] : fn{x) > a}, 

for a G [/(I — n~^)^ f{n~^)]. The next lemma is the analogue of Lemma 4.1. 



Lemma 5.2. Define the event 



supi/;(x)-/Mi< '"^-*"i{^:'i; 

xe[o,i] 2supig[o,i] |/"(2;)| 



Then P{A^} ^ 1. 



Proof. It suffices to show that sup^.gjo,i] l/n(^) ~ /(^)l ~^ 0- Using the 
definition of we can bound 



(5.3) 



sup |/^(x)-/(x)| 

XG[0,1] 

< sup |/^^(x) - /„(x)| + sup |/„(x) - /(x)|. 

xG[0,l] a;e[0,l] 



The first term on the right-hand side of (5.3) is smaller than sup|/'|n 
which, together with Lemma 4.1, implies that sup2.g[o,i] \fn{x) — f{,x)\ = 
Op(n-V6). □ 



Similar to (4.2), the difference between the modified L^-errors for /„ and 
is bounded as 



l-n- 



\U{x)-!(xtdx 



l-n- 



\fl{x)-f(xtdx 
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(5.4) </ \Ux)-f{x)fdx 



\Jn{X) - J 

+ / \Ux)-f{xtdx. 

The next lemma is the analogue of Lemma 4.2 and shows that both integrals 
on the right-hand side are of negligible order. 

Lemma 5.3. Fork> 2.5 and 1/6 < e < (A;-l)/(3A;-6), letU^ be defined 
in (5.2). Then 



and 

rl-n- 



\fn{x)-f{xtdx = Op{n-^''^+'y^) 

|A(x)-/(x)|^-dx = Op(?i-(2'=+l)/6). 



Proof. Consider the first integral. Then similar to (4.3), we have that 
(5.5) 2" \U{x)-f{n-n\'^dx 

+ 2' / \f{n-')-f{x)\''dx 

<2' / \Ux)-f{n-'tdx 

If we define the event i?^ = {U^{f {n"'')) — n"^ < n~^/^logn}, then by sim- 
ilar reasoning as in the proof of Lemma 4.2, it follows that {Un{f{n~'^)) — 
j^-E-jfc+i _ Q^j^j^-(2fc+i)/6-j_ rjij^g gj,g|. integral on the right-hand side of (5.5) 
can be written as 

\fn{x)-fin-'tdx)lB„ 
/ 



+ [J^_^ Unix)- fin-' tdxjlB^^: 



where the second term is of the order Op{n 

-{2fc+l)/6) by the same reasoning 

as before. To bound 

(5.6) / \fnix)-fin-'tdxW, 



we distinguish between two cases: 
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(i) l/6<e<l/3, 

(ii) l/3<e< (A;-l)/(3fc-6). 

In case (i), the integral (5.6) can be bounded by |/n(?^~^) — f{n~^)\^n~^/^ logn. 
According to Theorem 3.1 in [9], for < a < 1/3, 

(5.7) nV3(/„(n-") - /(n"")) ^ |4/(0)/'(0)|i/3y(0) 

in distribution, where V{0) is defined in (1.2). It follows that |/n(?^~^) — 
/(n~^)| = Op{n~^/^) and, therefore, (5.6) is of the order Op(n~(^'^+^)/^). 

In case (ii), similar to Lemma 4.2, we will construct a suitable sequence 
(a,)^]^, such that the intervals (n~"% n~"'+i], for i = l,2,...,m — 1, cover the 
interval (n"*", C/„(/(n~^))], and such that the integrals over these intervals 
can be bounded appropriately. First of all let 

(5.8) e = ai> a2> ■ ■■ > Om-i > 1/3 > a^, 

and let Zi = n~°'\ i = 1, . . . ,m, so that < zi < • • • < Zm-i n"^/^ < Zm- 
Then, similar to the proof of Lemma 4.2, we can bound (5.6) as 



/ \Ux) - f{n~'t dx]lB^<Y,{z,+i- z,)\fn{z^) - f{n~'t 



Since 1/3 < < e < 1 for i = 1, . . . , m — 1, we can apply (4.9) and conclude 
that each term is of the order Op(n~°'+i^^'^^~"')/'^). Therefore, it suffices to 
construct a sequence (oj) satisfying (5.8), as well as 

. , k{l-ai) 2k + 1 

(5.9) fli+i + > for ah i = 1, . . . , m - 1. 

2 6 

One may take 

ai =e, 

k(ai-l) 2k + l If k-1 \ 
am = ^^ + ^ + g(^^(^-^j forz = l,...,m-L 

Then (5.9) is satisfied and it remains to show that the described sequence 
strictly decreases and reaches 1/3 in finitely many steps. This follows from 
the fact that Ui <e and A: > 2.5, since in that case 

_k-2f k-1 \ 1 f k-1 
''^""'+'"^U(A:-2) ""V "8U(A;-2) " 
4k-9f k-1 \ 

As in the proof of Lemma 4.2, the argument for the second integral is similar. 
Now take B^^ = {1 - n"^ - t/^(/(l - n"^)) < n^^/^logn}. The case 1/6 < 
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e < 1/3 can be treated in the same way as before. For the case 1/3 < e < 
{k — 1)/ {2>k — 6), we can use the same sequence {ai) as above, but now define 
Zi = 1 — n~"'\ i = 1, . . . ,m, so that 1 > zi > • • • > Zm.~i > 1 — > Zm- 

Then we are left with considering 

lU-ifil-n--)) J 
m— 1 

< 5^(z,-z,+i)|/(l-n--)-/„(z,)|^ 

i=l 

As before, each term in the sum is of the order Op(n~"'+i~^(^~'^')/^), for 
i = 1, . . . , m — 1. The sequence chosen above satisfies (5.9) and (5.8), which 
imphes that the sum above is of the order Op(n~^^'^"'"^)/^). □ 

Apart from (5.4), we also need to bound the difference between integrals 
for Un and its cut-off version U^: 



f(i) \9'{a)\^~'^ Jf{i-n-^) \g'{a)\^-~^ 

(5.10) 

< /-/(O) \Un{a) - g{a)\' ^ rMi-n-n \U^{a) - g{a)\k 

~/fn(n-=) b'(a)l^"^ J.f[i) b'(o)l^"^ 

The next lemma shows that both integrals on the right-hand side are of 
negligible order. 

Lemma 5.4. For k > 2.5, let 1/6 < e < (A; — 1)/(3A; — 6). Furthermore, 
let Un be defined in (1.1) and let fn be defined in (4.1). Then 

If («)r 

and 

/(I) b'(a)r-i 

Proof. Consider the first integral and define the event An = {/(O) — 
fn{n~^) < n~^/^/logn}. For 1/6 < e < 1/3, according to (5.7) we have 

/(0)-/„(n--)<|/„(n-^)-/(0)| 

<\fnin-') - f{n-')\+snp\f'\n-' 

= Op(n-i/3) + o{n-') 

= Op{n~^^^/logn). 



(5.1i: 
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This means that, if 1/6 < e < 1/3, the probabihty P{A^} 0. For 1/3 < 
e < 1, 

P{A'},}<P{f{0)-Un-^)>0} 

< P{Un-') - f{n-') < n-^'sup|/'|} ^ 0, 

since according to (4.9), — /("'~^) is of the order n~(^~^)/^. Next 

write the first integral as 

V4(n-') b'(a)l'-i J " 

Similar to the argument used in Lemma 4.2, the second integral in (5.11) is 
of the order Op{n~^'^''^^^/^). The expectation of the first integral is bounded 

by 

J/{0)-n-l/6/logn \g{a)\ 

<n^^l^Ci / E\V^{a)\^da 

J/(0)-n-l/6/log„, 

<C2n(2'=+i)/Vlogn, 

using Lemma A.l. The Markov inequality implies that the first term in (5.11) 
is of the order Op(n~^^'^^^^/^). For the second integral the proof is similar. 
□ 

Theorem 5.1. Suppose conditions (Al)-(A3) of Theorem 1.1 are sat- 
isfied. Then for k > 2.5 and for any e such that 1/6 < e < (k — l)/(3fc — 6), 

\fnix)-f{xtdxY' -^^k] 

converges in distribution to a normal random variable with zero mean and 
variance af,, where fik o,nd af, are defined in Theorem 1.1. 

Proof. As in the proof of Theorem 1.1, it suffices to show that the 
difference 

'"""'if ( ^ f( Mk, /■^W |^n(a)-g(a)|" , 
\fn{x)-f{x)\ dx- — I — da 
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is of the order Op(n~'^^*''"*"^)/^). We can bound this difference by 

\f^{x)-fixtdx- 
\Un{a)-g{at 



(5.12) 
(5.13) 



l-n- 



l-n" 



+ 



(5.14) 



/(I) 
1-n- 



\mx)-fixtdx 



\f^{x)-f{xtdx 
n--n mia) - g{a)\'' 



/(l-n-=) 



|<7'(a)|^-i 



da 



k-1 



■ da 



Differences (5.12) and (5.13) can be bounded as in (5.4) and (5.10), so that 
Lemmas 5.3 and 5.4 imply that these terms are of the order Op{n~^'^^~^^^^^). 
Finally, Lemma 3.1 implies that (5.14) is bounded by 



|C/^(a)-<7(a)|^' 



fc+i 



b'(a)l^ 



■ da. 



Write the integral as 

rm \Un{a) - gia)\>'+^ 
A(i) 



da 



|g'(a)|fc 

m \Un{a) - g{at+' 
/(I) \9'ia)\^ 



da 



n^-n ma)-g{a)\ 



k+l 



b'(a)|^' 



■ da 



Then Corollary 2.1 and Lemma 5.4 imply that both terms are of the or- 
der Op(n-(2^+i)/6). This proves the theorem. □ 

APPENDIX 

The proofs in Section 2 follow the same line of reasoning as in [4] . Since we 
will frequently use results from this paper, we state them for easy reference. 
First, the tail probabilities of have a uniform exponential upper bound. 

Lemma A.l. For J = E,B,W, let be defined by (2.2). Then there 
exist constants Ci, C2 > depending only on f, such that for all n>l, 
aG (/(l),/(0)) andx>0, P{| V/(a)| > x} < Ci exp(-C2x3). 

Properly normalized versions of V^{a) converge in distribution to ,^(c) 
defined in (1.3). To be more precise, for aG (/(l),/(0)) define (pi{a) = 
|/'(g(a))|2/3(4a)-V3, ,/,2(a) = (4a)i/3|/'(5(a))|V3 ^nd 

(A.l) V;!jc) = Ma)V;!ia - Ma)cn-^/'), 

for J = E,B, W. Then we have the following property. 
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Lemma A. 2. For J = E,B, W, integer d>l, a G (/(I), /(O)) and c G 
Jn{aY , we have joint distributional convergence of {V^ai'^i)^ • ■ • > ^n.ai'^d)) to 
the random vector (C(ci), • • • ,^(crf)). 



Due to the fact that Brownian motion has independent increments, the 
process is mixing. 

Lemma A. 3. The process {V^(a):aG (/(l))/(0))} is strong mixing 
with mixing function a^id) = 12e"'^^"'^^, where the constant C3 > depends 
only on f. 



As a direct consequence of Lemma A. 3 we have the following lemma, 
which is a slight extension of Lemma 4.1 in [4]. 

Lemma A. 4. Let I and m be fixed such that I + m > and let h be a 
continuous function. Define 

C, = 2 /'(4/(x))(2'+2r.+l)/3|^.(^)|(4-4/-4H/3;,(^(^))2^^^ 



Then 

rfiO) 



var 



/ V^{ay\V^{a)rh{a)da 

POO 



as n — > 00 . 



Proof. The proof runs along the lines of the proof of Lemma 4.1 in [4]. 
We first have that 



Yav(n^/^ J^^ ^ V^{ay\V^{a)rh{a)da^ 

(^4^^(2«+2m+l)/3|^/^^^|(4(i+m)-l)/3 



/(I) 

/(O) .ni/3^2(a)-i(a-/(0)) 



/(I) -^0 

X h{a)h{a - (/>2(a)n^^/^c) 

xcov{VZ.{Oy\VZ{0)r,VZ{cy\VZ{c)ndcda. 

According to Lemma A.l, for a and c fixed, the sequence K!^(c)^|y„^(c)|™ is 
uniformly integrable. Hence, by Lemma A. 2 the moments of 
(K^ (0)1 (0) r ' (c)' I r ) converge to the corresponding moments 

of ('c(0)1C(0)r,^(c)'|^(c)r). Again, Lemma A.l and the fact that l + m> 
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yield that £;|Fj^(0)p('+™) and £;| V„^(c)p('+™) are bounded uniformly 
in n,a and c. Together with Lemma A. 3 and Lemma 3.2 in [4], this yields 
that 

where Di and D2 do not depend on n, a and c. The lemma now follows 
from dominated convergence and stationarity of the process ^. □ 



Proof of Theorem 2.1. Write 

\V^ {a)\^ - E\V^ {a) 



<(a) 



b'(a)| 



k-l 



and for d = /(O) — /(I), define L„ = dn~^/'^(logn)^, M„ = dn^^^^logn and 
A''„ = + Mn)~^], where [x] denotes the integer part of x. We divide the 
interval (/(l),/(0)) into 2Nn + 1 blocks of alternating length, 

A, = (/(I) + (i - 1)(L„ + M„), /(I) + (i - 1)(L„ + Mn) + L„], 
= (/(I) + (i - 1)(L„ + M„) + L„, /(I) + M„)], 

where j = 1, . . . , iV„. Now write T^^k = S'^j^ + + where 



Rn,k = n^'^ W^{a)da. 

J f{l) + Nn{Ln+M„) 



From here on the proof is completely the same as the proof of Theorem 4.1 
in [4]. Therefore, we omit all specific details and only give a brief outline 
of the argument. Lemmas A.l and A. 3 imply that all moments of W^{a) 
are bounded uniformly in a and that E\Wll{a)W^{b)\ < Diex.p{—D2n\b — 
a\^). This is used to ensure that ER'^ and that the contribution of the 
small blocks is negligible: E{S" — > 0. We then only have to consider the 
contribution over the big blocks. When we denote 

Yj=n^/^ j W^{a)da and al = wai(^Y\ 



we find that 



\ iu ^ ( iu 



j = l ) j = l 



< 4(7V„ - 1) expi-CsnM^) ^ 0, 
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where C3 > depends only on /. This means that we can apply the central 
limit theorem to independent copies of Yj. Since the moments of |Ty^(a)| 
are uniformly bounded, we have that, for each e > 0, 

— J2EY^\K\>ea^}<-T^n sup E\Yjf = 0{a~'n-'/' (lognf) . 

By similar computations as in the proof of Theorem 4. 1 in [4] , we find that 
o"^ = var(r„ fc) + 0(1), and application of Lemma A. 4 yields that a'^^ a'^. 
This implies that the 1^ 's satisfy the Lindeberg condition, which proves the 
theorem. 

□ 



In order to prove Lemma 2.1, we first prove the following lemma. 

Lemma A. 5. Let he defined by (2.2) and let V{0) be defined by 
(1.2). Then for k>l, and for all a such that 

(A.2) n'/^F{g{a)) A (1 - F(<7(a)))} > logn, 

we have 

where the term 0(ri~-'^/'^(logn)^"'"^) is uniform in all a satisfying (A.2). 

Proof. The proof relies on the proof of Corollary 3.2 in [4]. There it 
is shown that, if we define Hr,{y) = n^/^{H{F{g{a)) + n-^/^y) - g{a)}, with 
H being the inverse of F, and 

Vn,b = sup{y G [-n^^^F{g{a)),n^^^{l - F{g{a)))] : W{y) - by^ is maximal}, 

with b = \f'{g{a))\/{2a'^), then for the event A„ = {|F„^(a)| < logn, 
\Hn(yn,b)\ < logn}, one has that P{A^J is of the order C)(e-^('°s")'), which 
then implies that 

sup E\V;^ia) - Hn{Vn,b)\ = 0(n-i/3(logn)4). 

«G{/{l),/(0)) 

Similarly, together with an application of the mean value theorem, this yields 

(A.3) sup E\\V^{a)\'^ - \H^{V^,,t\ = 0(n-V3(logn)3+^'). 

"e(/(i),/(0)) 

Note that, by definition, the argmax V^^^ closely resembles the argmax Vf,(0), 
where 

(A.4) H(c) = argmax{W^(t) - b{t - cf}. 
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Therefore, we write 

(A.5) E\Hn{Vn,bt = E\Hn{Vmt + E{\Hn{Vn,bt - \Hn{Vmt)- 

Since by Brownian scaling Vb(c) has the same distribution as 6~^/^y(c6^/^), 
where V is defined in (1.2), together with the conditions on /, we find that 



:E\V{{))\'' + 0{n 



As in the proof of Corohary 3.2 in [4], V^fi can only be different from Vf,(0) 
with probability of the order 0(6"^^/^^^^°^""^^). Hence, from (A.5), we con- 
clude that 

Together with (A. 3), this proves the lemma. □ 

Proof of Lemma 2.1. The result immediately follows from Lemma A.5. 
The values of a for which condition (A. 2) does not hold give a contribution 
of the order C'(n~^/^logn) to the integral / E\V^ {a)\^ da, and finally, 

da= ('m^)f"\f'{xtl^dx. 



/(I) \f'{9{aW'^\g'{a)\>^-^ v . v u v • □ 

Proof of Lemma 2.2. The proof of the first statement relies on the 
proof of Corollary 3.3 in [4]. Here it is shown that, if for a belonging to the 
set J„ = {a:both a and a(l -^nn'^/^) G (/(l),/(0))} we define 

then for the event An = {|C„| < n^e^ |V„^(a)| < logn, \V^{a,in)\ < logn}, 
one has that P{A^} is of the order 0(6"*^^^°^"^^). This implies that 

/ E\V^^{a,Cn) - V^{a)\ da = 0{n''/''{lognf). 

J a&Jn 

Hence, by using the same method as in proof of Lemma A.5, we obtain 

/ E\\V^{a,int-\V^{at\da = 0{n-^/\\ognf+^). 

From Lemma A.l, it also follows that E\V^{a)\'' = 0(1) and ElV^ia)^ = 
0{1), uniformly with respect to n and a € (/(l),/(0)). Hence, the contri- 
bution of the integrals over [/(l),/(0)] \ J„, is negligible, and it remains to 
show that 

(A.6) f {\V,^(a,Cnt-K^iat}da = o,il). 

J adJn 
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For k = 1 this is shown in the proof of Corohary 3.3 in [4], so we may assume 
that k > 1. Completely similar to the proof in the case k = 1, we first obtain 

n'^' f {K^{a,Ut-K^{a)f}da 

J aeJn 

= n'/' / {\V^^{a) - ag'(a)enn-^/Y " IK^" («)l'} da + Op{n-'/^). 

Let e > and write An(o) = ag' {a)^nfi~^^^ ■ Then the first term on the right- 
hand side equals 

(A.7) / {\V^{a)-^n{at-\V^{at}^,^4\V^{a)\)da 

(A.8) +nV6 / {|v;^(a)-A„(a)|^--|K^(a)|n%oo)(l^n''(a)l)^a- 

-'/(I) 

First consider the term (A.7). When |l^(a)| < 2|A„(a)|, we can write 
||y„^(a) - A„(a)|^- - iKf < 3^-|A„(a)|^ + 2'^|A„(a)|'= 

<(3'= + 2'=)|a<7'(a)en|'n-'=/'. 

When \Vj^{a)\ > 2|A„(a)|, we have 

IlKf (a) - Ar^iat - \V^^iat\ = k\9\'-^\ag' {a)Cr,\n~'/\ 

where 9 is between |F^(a)| < e and \Vj^{a) — A„(a)| < |e. Using that 
and Vj^ are independent, the expectation of (A.7) is bounded from above 

by 

Cie''"'E\U\ f^^'\ag'{a)\P{\V„''{a)\<e}da + Op{n-'^''~'^/^), 
where Ci > depends only on / and k. Hence, since k> 1, we find that 
limsupni/6 [^^'\\Vj'ia) - ag' {a)Un~'/'\' - l^f («)l'} 

n— >oo J f(l) 

(A.9) 

Xl[o,e](lKf(«)l)da 

is bounded from above by C2e''~^, where C2 > depends only on / and k. 
Letting e | and using that k > 1 then yields that (A.7) tends to zero. 
The term (A.8) is equal to 

'■m -2e„a5'(a)K^(a) + iag'{a)Ufn-y^ 



, , //(i) |Kf(a)-A„(a)| + |K^(a) 

(A.IO) 

^ke{af-H^,^^^{\V^{a)\)da, 
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where 6 (a) is between \ V^ {a) - An{a)\ and \V^ia)\. Note that for \V^{a)\ > 



e 



\V£ia)-A4a)\ + \V^^{a)\ |Kf(a 
uniformly in a G (/(l),/(0)), so that (A. 10) is equal to 
r.no) 
'/(I) 



We have that 



y-(a)|^-i-%r^|<|y-(a 



lfc-l 



A„(a) 



fe-i 



Op{n 



where the O-term is uniform in a. This means that (A. 10) is equal to 



(A.ll) 



(A.12) 



.no) 



ag'{a)V^^{a)\V^^{at-'da 



+ kCn / ag'{a)sign{V^^{a))\V^^iat~H[o.e){\Vji'ia)\)da 



The integral in (A.12) is of the order 0{e^ ^), whereas i?^^ = 1. Since k > 1, 
this means that, after letting e [ 0, (A.12) tends to zero. For (A.ll), let 
S^{a) = ag'{a)V^{a)\V^{a)\''~^ and consider E{jS^{a)daf = 
var(/ S^{a)da) + {E J (a) da)^ . Then, since according to Lemma A.l all 
moments of \S^{a)\ are bounded uniformly in a, we find by dominated con- 
vergence and Lemma A. 2 that 

Jim / S^ia)da = J ^^(£;e(0)|C(0)|^-^) da = 0, 

because the distribution of ^(0) is symmetric. Applying Lemma A. 4 with 
1 = 1, m = k — 2 and h{a) = ag'{a), we obtain var(/ Snia) da) = 0{n~^/^). 
We conclude that (A. 10) tends to zero in probability. This proves the first 
statement of the lemma. 

The proof of the second statement relies on the proof of Corollary 3.1 
in [4]. There it is shown that, for the event A„ = {|V^^(a)| < logn, |V"^(a)| < 
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logn} one has that P{A'^} is of the order C'(e~'^*'^°^"'^^). Furthermore, if 
Kn = {supt \Enit) - BniF{t))\ < n~^/^logn)^} , then P{K„} ^ 1 and 

(A.13) E\\V^^{a)\ - |K^(a)||lA„n/r„ = 0(n-i/3(iogn)3) 

uniformly in a € (/(l),/(0)). By the mean value theorem, together with 
(A.13), we now have that 

i5^l|Vf(a)l'-|Kf(«)hli^„ 

< k(\ogn)'-^E\\V^^{a)\ - \V^^ ia)\\U„nK^ + 2n^/^P{A^J 

This proves the lemma. □ 

This completes the proofs needed in Section 2 to obtain a central limit 
theorem for the scaled L^-distance between C/„ and g (Corollary 2.1). The 
remainder of this appendix is devoted to the proof of Lemma 5.1, which 
indicates that a central limit theorem for the Lfc-distance between /„ and / 
is not possible when k > 2.5. For this we need the following lemma. 

Lemma A. 6. Let k > 2.5 and Zn = l/(2n/(0)). Then there exist < 
oi < 6i < a2 < 62 < 00, such that, for i = 1,2, 

liminf p(n T" \fnix) - fix)\''dx G [aiM]] > 0. 

I JO J 

Proof. Consider the event An = {Xi > Zn, for all i = 1,2, . . . ,n}. Then 
it follows that P{An} l/^/e> 1/2. Since on the event A^ the estimator 
fn is constant on the interval [0, Zn], for any > we have 

P\n r\fn{x)-f{xtdxe[ai,bi] 



> P| (^n^'" |/„(0) - fix^dx^ 1a„ G [at A] 
" IV 27(0) j " K>o»J|. 



where 



Rn = n I ken{x)''-\\fn{0)-f{x)\-\fn{0)-fm)dx, 



with 6'„(x) between |/„(0) - f{x)\ and |/„(0) - /(0)|. Using (4.7), we obtain 
that Rn is of the order Op{n~^) and, therefore. 



l/n(0)-/(0)|'= /(O)^-^ 
- + 



2/(0) 



sup — 

l<j<oo J- j 
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in distribution. Now choose < ai < 61 < 02 < 62 < oo such that, for i = 1, 2, 



P 



/(O) 



sup - 1 

l<j<oo ^ j 



k 



£ [ai,b^] \ >1-1/Ve. 



2 

Then for i = l,2 we find 

p(^nJ^'"\Ux)-f{xtdxe[ai,bi 

which converges to a positive value. □ 

Proof of Lemma 5.1. Take < ai < 61 < 02 < ^2 < 00 as in Lemma A. 6, 
and let Ani be the event 

Ani = S^nJ^ \fn{x)- f{x)\''dxe[ai,bi 

Then 

n'^/'E (\ux)-f{xtdx>n^'''E r \U{x) - f{xt dxU^, 
Jo Jo 

>ain('=-3)/3p{A„i}. 

Since according to Lemma A. 6 P{Arti} tends to a positive constant, this 
proves (i). 

For (ii), write Xn = nj^" \fn{x) - f{x)\''dx, and define Bn = {EXn > 
(a2 + 6i)/2}. Then 

var(X„) > E{Xn - EXnflA„,nB„ + E{Xn - EXnflA„,nB^„ 

> i(a2 - bifP{Anl}lBr. + i(a2 - bifP{An2}lBg 

> i(a2 - bif mm{P{Ani},P{An2}). 
Hence, according to Lemma A. 6, 

liminfvarf n^^^'+^^Z^ tfj^-. _ fMl^dx ' 

> lim^inf n(2^-5)/3i(^^ _ ^m{P{Ani}, P{An2}) = 00. □ 
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